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Abstract 

We give sufficient conditions on a symmetric tensor S £ S d F" to sat¬ 
isfy the equality: the symmetric rank of <S, denoted as srank S , is equal to 
the rank of S , denoted as rank S. This is done by considering the rank 
of the unfolded S viewed as a matrix A(5). The condition is: rank S £ 

{rank A(<S), rank A(S) + 1}. In particular, srank S = rank S for S £ S d C n 
for the cases ( d , n) £ {(3,2), (4,2), (3,3)}. We discuss the analogs of the above 
results for border rank and best approximations of symmetric tensors. 
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1 Introduction 


For a field F let ® d F n D S d F n denote d-mode tensors and the subspace of symmetric 
tensors on F n . Let T £ <8> d F n . Denote by rank T the rank of the tensor T. That 
is, for T y 0 rank T is the minimal number k such that T is a sum of k rank 
one tensors, (rank 0 = 0.) We say that T has a unique decomposition as a sum 
rank T rank one tensors if this decomposition is unique up to a permutations of 
the summands. Assume that S £ S^F” \ {0}. Suppose that |F| > d, i.e. F has at 
least d elements. Then it is known that S is a sum of k symmetric rank one tensors 
[14, Proposition 7.2], See [1] for the case |F| = oo, i.e. F has an infinite number of 
elements. The minimal k is the symmetric rank of S, denoted as srank S. Clearly, 
rank S < srank S. In what follows we assume that d > 3 unless stated otherwise. 
In [20, P15, page 5] P. Comon asked if rank S = srank S over F = R, C. This 
problem is also raised in [7, end §4.1, p’ 1263]. This problem is sometimes referred 
as Comon’s conjecture. In [7] it is shown that this conjecture holds in the first 
nontrivial case: rank 5 = 2. 

For a finite field the situation is more complicated: Observe first that for F = Z 2 


and the symmetric matrix A 


0 1 
1 0 


we have the the inequality rank A = 2 < 


srank A = 3. (A is a sum of all three distinct symmetric rank one matrices in 
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S 2 Z 2 .) Second, it is shown in [14, Proposition 7.1] that over a finite held there exist 
symmetric tensors that are not a sum symmetric rank one tensors. 

To state our result we need the following notions: For n £ N denote [n] = 
{1,... , n}. Let S = [sii,...,i d ]i lj ...,i d e[nl *= S d ¥ n . Denote by A(S) an n x matrix 
with entries b a p where a £ [n] and (3 = (/3i ,..., Pd-i) € [n] d_1 . Then b a p := 
s a ,ft,...,|3 d _r (A(«S) £ F nxn 1 is the unfolding of 5 in the direction 1. As 5 is 
symmetric, the unfolding in every direction k £ [d] gives rise to the same matrix.) 
Hence rank A(<S) < n. If m := rank A(S) < n it means that we can choose another 
basis so that S is represented as S' £ S d F m . Recall that rank S > rank A(S). (See 
for example the arguments in [12] for d = 3.). Thus, to study Comon’s conjecture 
we can assume without loss of generality that rank A(<S) = n. 

Denote by H(n, d, F) and T, s (d, ra,F) the Segre variety of rank one tensors plus 
the zero tensor and the subvariety of symmetric tensors of at most rank one in 
(F n )®d 

Let Fd : n,k ■ H(n, d, F) fc —>• (F n ) 0d be the polynomial map: 

k 

Fd,n,k{('Ti, •. • ,7fc)) := YTi- (1.1) 

3 = 1 

Let. T = Fd t n,k(( 7i, • • •, 7fc)). In what follows we say that the decomposition T = 
^2j = i Tj is unique if rank T = k and any decomposition of T to a sum of r rank one 
tensors is obtained by permuting the order of the summands in T = 7 j- 

Denote by Gd, n ,k the restriction of the map Fd, n ,k to : S s (n, d, ¥) k . Thus 
Fd,n,k(^( n J d, F) fc ) and Grf A / ! (S s (?i, d, F) fc ) are the sets of of d-mode tensors on F" 
tensors of at most rank k and of symmetric tensors of at most symmetric rank k. 

Chevalley’s theorem yields that Fd !n ^(S(?r, d, C) fc ) and G^ n! fc(S s (ra, d, C) fc ) are 
constructible sets. Hence the dimension of Gd,n,k(^s(n-,d,C) k ) is the maximal rank 
of the Jacobian of the map Gd, n ,k- 

S £ S d C n is said to have a generic symmetric rank k if the following conditions 
hold: First, the dimension of the constructible set Grf in! fc(E s (n, d, C) fc ) is greater than 
the dimension of G^ n! fc_i(S s (n,d,C) fc_1 ). Second, there exists a strict subvariety 
O C E(n, d, C) fc , such that S £ Gd t n,kC^s(n, d, C) k \0). Let 

fn+d— 1\ 

Kd := 1 d ■ ( 1 - 2 ) 

n 

Chiantini, Ottaviani and Vannieuwenhoven showed recently [5] that if S £ S d C n 
has a generic symmetric rank k < k Uj d then k = rank S. It is much easier to establish 
this kind of result for smaller values of k using Kruskal’s theorem. See [14, Theorem 
7.6], 

The aim of this paper is to establish a much weaker result on Comon’s conjecture, 
which does not use the term generic. In particular we show that Comon’s conjecture 
holds for symmetric tensors of at most rank 3 and for 3-symmetric tensors of at most 
rank 5 over C . 

Our main result is 

Theorem 1.1 Let d > 3, |F| > 3 and S £ S d F n . Suppose that rank S < 
rank A(S) + 1. Then srank S = rank S. 
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We now summarize briefly the content of this paper. In §2 we recall Kruskal’s 
theorem on the rank of 3-tensor. In §3 we prove Theorem 1.1 for the case rank S = 
rank H(5). In §4 we show that each S G S 3 F 2 , where |F| > 3, satisfies srank S = 
rank S. In §5 we prove Theorem 1.1 in the case d = 3 and rank S = rank H(<S) + 1. 
In §6 we prove Theorem 1.1 for d > 4. In §7 we summarize our results for F = C. In 
§8 we discuss two other closely related conjectures: The first one conjectures that it 
is possible to replace in Comon’s conjecture the ranks with border ranks. We show 
that this is true if the border rank of S is two. The second one conjectures that 
a best ^-approximation of symmetric tensor can be chosen symmetric. For k = 1, 
i.e. best rank one approximation, this conjecture holds and it is a consequence of 
Banach’s theorem [2], 

2 Kruskal’s theorem 

We recall Kruskal’s theorem for 3-tensors and any field F. For p vectors xi,..., x p € 
F n denote by [xi X 2 • • • x p ] the nxp matrix whose columns are xi,..., x p . Kruskal’s 
rank of [xi X 2 • • • x p ], denoted as Krank (xi,... ,x p ) is the maximal k such that 
any k vectors in the set {xi,... ,x p } are linearly independent. (If Xj = 0 for some 
i € [p] then Krank (xi,... ,x p ) = — oo.) 

Theorem 2.1 (Kruskal) Let F be a field, r G N and Xj G F m ,y; € F n ,z$ € F p 
for i G [r]. Assume that 

r 

T = ^2 Xj <g> yj <g) Zj. (2.1) 

i= 1 

Suppose that 

2r + 2 < Krank (xi,..., x r ) + Krank (yi,..., y r ) + Krank (zi,..., z r ). (2.2) 

Then rank T = r. Furthermore, the decomposition (2.1) is unique. 

Note that max(Krank (xi,..., x r ), Krank (yi,..., y r ), Krank (zi,..., z r )) < r. Hence 
(2.2) yields that 

min(Krank (xi,..., x r ), Krank (yi,...,y r ), Krank (z\, ...,z r )) > 2. (2.3) 

In particular, min (m,n,p) > 2. 

In what follows we need a following simple corollary of Kruskal’s theorem: 

Lemma 2.2 Let 3 < d G N. Assume that x^i,... ,Xj jr € F”j are linearly 
independent for each j G [d]. Let 


T = (2-4) 

i —1 

Then rank T = r. Furthermore, the decomposition (2.4) is unique. 

Proof. Observe first that <S>j = iXj,i, - - - ,<8>j =1 Xj, r linearly independent for p = 
1,... ,d. Clearly, this is true for p = 1 and p = 2. Use the induction to prove this 
statement for p > 3 by observing that = (<8>j=ixjy) <8> x P) ., for p = 3, ..., d. 
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Consider T given by (2.4). Suppose first that r = 1. Then T is a rank one tensor 
and its decomposition is unique. Assume that r > 2. Consider T as a 3-tensor on 
the 3-tensor product F" 1 <8> F” 2 (?) (<8>jL 3 F n j). Clearly 

Krank (x^i,..., x. r q) = Krank (xi j2 ,..., x rj 2 ) = (2-5) 

ICrank (®j = 3 x jtl ,..., ® d j= 3 x jyr ) = r. 

As 3r — 2 > 2 r, Kruskal’s theorem yields that the rank of T as 3-tensor is r. Hence 
rank T as d tensor is r too. Furthermore the decomposition (2.4) of T as a 3-tensor 
is unique. Hence the decomposition^.4) is unique. □ 

In what follows we need the following lemma. 

Lemma 2.3 Let d > 3,n > 2 and S £ S d ¥ n . Assume that 

k 

<S = y^t8>j =1 Xj ; i. (2.6) 

2—1 

Then S = Yli=i ®j=i x cr(j),i f or an y permutation a of [d] . Suppose that the following 
inequality holds: 

2 k+ 2 < K(xi i ,... ,x ljfc ) + K(x 2 , 1 ,... ,x 2jfc ) + 

K(jS>j =3 Xj i, ..., ( 2.7 ) 

Then rank S = srank S = k, i.e. span(x lii ) = ... = span(x^j) for each i G [A:]. 
Furthermore, the decomposition (2.6) is unique. 

Proof. Assume that (2.6) holds. Since S symmetric we deduce that S = 
Eti i x CT (j). j for any permutation a of [d] . Suppose that (2.7) holds. Kruskahs 

theorem yields that the decomposition of S as a 3-tensor on F” (g> F” <S> ((8> rf_2 F ra ) 
is unique. In particular, the decomposition (2.6) is unique. Hence rank S = k. 
Let a be the transposition on [d] satisfying <r(l) = 2, a(2) = 1. Then S = 
Yl!i=i® d j=v^a(j),i- ( 2 -3) yields that K(^ = 3 Xj t i,..., ®j = 3 Xj,k) > 2. That is, the 
rank one tensors (8 ) d = 3 Xj tP and ®j = 3 Xj, q are linearly independent for p < q. The 
uniqueness of the decomposition (2.6), (up to a permutation of summands), yields 
that xi ; j <8) X 2 ) j (8> ( ®j= 3 Xj t i ) = x 2! i <8> x^j <8> (®j = 3 Xj,i) for each i £ [n]. Hence 
xj.j <8) x r 2 ; i = X 24 <8> x^j. Therefore xj j and x 2 j are linearly dependent nonzero 
vectors. Let cr be a transposition on [d] satisfying a(2) = p, cr(p) = 2 for some 
p > 3. (2.3) yields that iF(xi ; i,..., xi^) > 2. The uniqueness of the decomposi¬ 
tion (2.6), (up to a permutation of summands), yields that x^j <8>x 2) j <8> (®j = 3 Xj t i) = 
xi j j(8>Xp ) j<8)(<8ij =3 x (T ( J ) !i ). Therefore x 2) i and x pq are collinear for each i £ [n]. Hence 
span(xi j j) = ... = span(x< 2 ; j) for each i £ [d]. Thus the decomposition (2.6) is a 
decomposition to a sum of symmetric rank one tensors. Hence srank S = rank S. □ 


3 The case rank S = rank A(S) 

Theorem 3.1 Let d > 3, n > 2 and S £ S(d, F n ). Suppose that rank S = 
rankA(<S). Then srank <S = rank S. Furthermore, S has has a unique rank one 
decomposition. 
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Proof. We can assume without loss of generality that rank A(«S) = n. So (2.6) 
holds for k = n. Clearly, Xj, i,..x j n are linearly independent for each j G [d]. 
Hence K(xj } i,. . ., Xj, n ) = n for j € [d]. The proof of Lemma 2.2 yields that 
..., L 3 Xj>) = n. Therefore equality (2.5) holds for r = n. As n > 2 
we deduce (2.7) for k = n. Lemma 2.3 yields the theorem. □ 

The following corollary generalizes [7, Proposition 5.5] to any field F: 

Corollary 3.2 Let ¥ be a field, S G S d F n \ {0}, d > 3. Assume that rank S < 2. 
Then srank S = rank S. 

Proof. Clearly, rank A(S) G {1,2}. If rank A(S) = 1 then S = s <g> d u. Hence 
rank S = srank S = 1. If rank A(5) = 2 then rank S = 2 and we conclude the 
result from Theorem 3.1. □ 


4 The case S 3 F 2 

Theorem 4.1 Let S G S 3 F 2 . Assume that |F| > 3. Then rank S = srank S < 3. 

For F = C this result follows from the classical description of binary forms in two 
variables due Sylvester [23]. More generally, consult with [ 6 ] for results on the rank 
of tensors in S d ¥ 2 for an algebraic closed field F of characteristic zero. 


Proof. In view of Corollary 3.2 it is enough to consider the case where 
rank S > 3. Let S = [si,j,k]i,j,ke[ 2 \- 

1. Assume that 81 , 1 , 281 , 2,2 0. Let 


3 

S = ^2 ti W, ui = (1, 6) t , u 2 = (1,0) t , u 3 = (0,1) T . 

i= 1 


Then 


£ 1 , 1,2 = hb, 81 , 2,2 = hb 2 = b 

t 2 = 81 , 1,1 — ti, ts = S 2 , 2,2 — hb 3 ■ 


51.2.2 

51.1.2 ’ 


(4.1) 


Hence rank S < 3. Our assumption yields that rank <S = 3 and (4.1) is a 
minimal decomposition of S to rank one tensors. This decomposition shows 
that rank S = srank S. 


2 . Assume that si,i , 2 = 81 , 2,2 = 0 then S = 81 , 1,1 < 8> 3 (1,0) T + 82 , 2,2 (0,1) T . 

This contradicts our assumption that rank S > 3. 

3. It is left to discuss the case where rank S > 3 and si,i ,2 = 0 and si , 2 ,2 0. 

The homogeneous polynomial of degree 3 corresponding to S is 

f(x 1 ,X 2 ) = 8 i,i,ixf + 81 , 2 , 2 ^ 1^1 + 82 , 2 , 2 ^ 1 - 

(a) Assume that the characteristic of F is 3. Make the following change of 
variables: x\ = y\,x-i = yi + V 2 - The new tensor S' satisfies 1. 
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(b) Assume that the characteristic of F is not 3. 

i. Assume that si,i,i 7 / 0. Make the following change of variables: 
xi = y\ + ay 2 ,x 2 = y 2 . Then 

f{yi,V 2 ) = ayf+Py\y 2 +iyiyl+5, f3 = 3 as Ui i ,7 = si, 2 , 2 + 3 a 2 si,i,i. 

Then choose a nonzero a such that £ 1 , 2,2 + 3a 2 si,i,i / 0. (This is 
always possible if |F| > 4 as we assumed that F 7 / Z 3 and |F| > 3.) 
The new tensor S' satisfies 1. 

ii. Assume that si. 1,1 = £ 2 , 2,2 = 0. Make the following change of vari¬ 
ables: X\ = yi, x 2 = (yi + y 2 ). Then we are either in the case 1 if the 
characteristic of F is not 2 or in the case 5(b)i if the characteristic 
of F is 2. 

iii. Assume that £ 1 . 1,1 = 0 and £ 2 , 2,2 7 ^ 0. Make the following change of 

variables: y 2 = £ 1 , 2,224 + s 2:2)2 x 2 ,y 2 = x 2 . Then we are in the case 
3(b)ii. □ 


Note that if |F| 1 then using the change of coordinates and then the above 

procedure we obtain that if rank S = 3, rank A(5) = 2 we have many presentation 
of S as sum of three rank one symmetric tensors. 

Observe next that for F = Z 2 not every symmetric tensor S G S 3 ^ is a sum 
of rank one symmetric tensors. The number of all symmetric tensors in S 3 Z 2 is 2 4 . 
The number of all nonzero symmetric tensors which are sum of rank one symmetric 
tensors is 2 3 — 1. Hence Theorem 4.1 does not hold for F = Z 2 . 

Corollary 4.2 Let S G S 3 F n . Assume that |F| > 3 and rank S = 3. Then 
srank S = rank S. 

Proof. Clearly, rank A(«S) G {2,3}. If rank A(S) = 3 we deduce the corollary 
from Theorem 3.1. If rank A(«S) = 2 we deduce the corollary from Theorem 4.1. □ 


5 The case d = 3 and rank S = rank A(S) + 1 

In this section we prove Theorem 1.1 for d = 3. In view of Theorem 3.1 it is enough 
to consider the case rank S = rank A(S) + 1. Furthermore, in view of Theorem 4.1 
it is enough to consider the case rank A(«S) > 3. We first give the following obvious 
lemma: 

Lemma 5.1 Let |F| > 3 and S G S(3,F"). Suppose that rank S = rank A(S) + 
1. Assume furthermore that there exists a decomposition of S to rank A(S) + 1 
rank one tensors such that at least one of them is symmetric, i.e. s <g> 3 u. Let S' = 
5 —s(g> 3 u. Then rank S' = rank«S — 1 and rank ^(5') G {rank A(<S) —1, rank A(5)}. 
Furthermore: 

1 . //rank A(5 / ) = rank A(S) then rank S' = rank A(«S / ) and rank S' = srank S'. 
Hence rank S = srank S. 

2. If rank A(S') = rank A(«S) — 1 then rank S' = rank A(«S') + 1. 
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5.1 The case rank A(<S) = 3 

We now discuss Theorem 1.1 where S G S(3,F"), where rank S = 4, rank A(5) = 3. 
Without loss of generality we can assume that n = 3. Then 

4 

S = ^x, : (g)Zj. (5.1) 

i —1 

Suppose first that there is a decomposition (5.1) such that Xj<g>yj(g)Zj is symmetric 
for some i € [4]. Then we can use Lemma 5.1. Apply Theorems 3.1 and 4.1 to deduce 
that srank S = rank <S = 4. 

Assume the Assumption: there no is a decomposition (5.1) such that <gyj<gz,; 
is symmetric for some i G [4], The first part of Lemma 2.3 yields: 

4 

0 = ^2 x i ® (y?: <8> z i - zi (g> yj). 

i= 1 

As rank A(<S) = 3 we can assume that xi,X 2 ,X 3 are linearly independent. Then 
X 4 = X)y = i a ] x j- Then the above equality yields: 

3 

0 = ^2 Xj <S> (yj <g> z j — z j (g) yj + Oj(y 4 < 8 > z 4 - z 4 <g) y 4 )). (5.2) 

3 =1 

As x 4 ,X 2 ,X 3 are linearly independent it follows that 

Yj ( 8 > Zj - Zj <g> yj = — ctj(y 4 ®z 4 -z 4 ® y 4 ) for j G [3]. (5.3) 

Assume first that y 4 and z 4 are collinear. Then y j and zj are collinear for 
j G [3]. Hence we w.l.o.g we can assume that y* = z % = u* for i G [4]. So S = 
x * ® Uj<g)u. ; ;. Since S is symmetric we can we obtain that S = Ui<gUj(g)x,:. 
Renaming the vectors we can assume that in the original decomposition (5.1) we 
have that x$ and y,; are collinear for i G [4]. Since we assumed that no rank one 
tensor Xj <g) yj (g> Zj is not symmetric, we deduce that each pair yj, z* in the original 
decomposition (5.1) is not collinear. In particular, it is enough to study the case 
where y 4 and z 4 are not collinear, i.e. y 4 ®z 4 -z 4 ®y 4 / 0. Let U := span(y 4 , z 4 ). 
Then dim U = 2. 

Suppose that «j / 0 for some j G [3]. Then (5.3) yields that yj and Zj are not 
collinear and span(yj,Zj) = U. Assume that aj = 0. Then y j and Zj are collinear. 

Assume first that 010:203 / 0. Then the above arguments yields that span(yi,..., y 4 ) 
C U, which contradicts the assumption that span(yi,..., y 4 ) = F 3 . 

So we need to assume that at least one of a* = 0 . Assume first that exactly 
one Oj = 0. Without loss of generality we can assume that in (5.2) a± = 0 
and 0203 / 0. This yields that y 1 and z\ are collinear. Our Assumption yields 
that xi and yi are not collinear. Furthermore span(y2,Z2) = span(y3,Z3) = U. 
Hence span(y 2 , y 3 ,y 4 ) C U. As span yi,y 2 ,y 3 ,y 4 is the whole space, we de¬ 
duce that yi ^ span(y 2 , y 3 , y 4 ). Similarly yi ^ span(z 2 , Z 3 , z 4 ). Furthermore, 
dim span(y 2 , y 3 , y 4 ) = 2. Hence span(y 2 , y 3 , y 4 ) = U. We now recall that S = 
£A_i yjgxjigz,:. Again, by renaming the indices 2,3,4 we can assume that y 1 , y 2 , y. 3 , 
are linearly independent. Since span(y 2 , y 3 , y 4 ) = U it follows that y 4 = & 2 y 2 +& 3 y 3 - 
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Since S is symmetric we have the equality S = ^N =1 Yi <8> x i <8> Zj. Permuting the 
last two factors we obtain the equality 0 = £T =1 y i ® (x$ <8> z* — z, (8> yj). Hence we 
have an analogous equality to ( 5 . 2 ): 

3 

0 = yi <8> (xi <8> zi — zi (8) xi) + ^ yj <g) (x,- <8> Zj — Zj <g) Xj + 6j(x 4 <8> Z4 — Z4 <g> X4)). 

3 =2 

Therefore xi (8> zi — zi (g> xi = 0 . Thus xi and zi are collinear. Recall that we 
already showed that yi and zi are collinear. Hence xi <8> y 1 <8> zi is a symmetric rank 
one tensor. So we have a contradiction to our Assumption. 

Finally let us assume that at = a,j = 0 for some two distinct indices i,j £ [3]. 
W.l.o.g. we can assume that X4 = X3, i.e. a\ = 02 = 0,03 = 1. This implies that y, 
and z i are collinear for i = 1 , 2 . Furthermore 

C := y 3 0 z 3 + y 4 (g> z 4 = z 3 (g> y 3 + z 4 (2) y 4 . 

So C is a symmetric matrix. Note that C is a rank two matrix. Otherwise y3®Z3 and 
y 4 z 4 are collinear. Then X 3 < 8 >y 3 < 8 )Z 3 +X 3 < 8 >y 4 < 8 >Z 4 is a rank one tensor. So rank S < 

3, contrary to our assumptions. Thus we can assume that C = y3 <8> y 4 + y4 <8> y3 
and y 3 ,y 4 are linearly independent. Hence we can assume that 

S = xi <8> yi <8> yi + x 2 ® y 2 ® y 2 + x 3 ® (y 3 <8> y 4 + Y4 <8> y-s) = 

yi <8> xi <8> yi + y 2 O x 2 ® y 2 + y 3 <8> x 3 ® y 4 + y 4 <8> x 3 <8) y 3 = 
yi < 8 ) yi <81 xi + y 2 < 8 > y 2 ® x 2 + y 3 < 8 > y 4 < 8 > x 3 + y 4 < 8 > y 3 < 8 > x 3 . 

Our Assumption yields that the pairs xi,yi and x 2 ,y 2 are linearly independent. 
Hence Q := x 4 <8> yi — yi <8> x 4 7^ 0 . Subtracting the third expression for S from the 
second one we deduce 

yi <8> (xi <8> yi - yi <8> xi) + y 2 ® (x 2 <g> y 2 - y 2 <8> x 2 ) + 
y 3 O (x 3 (8> y 4 - Y 4 <8) x 3 ) + y 4 <8> (x 3 <g> y 3 - y 3 <8> x 3 ) = 0 

As y 3 , y 4 are linearly independent, without loss in generality we may assume that 
y 2 ,y 3 ,y 4 are linearly independent. So yi = 6 2 y 2 + 6 3 y3 + 64y 4 . Substitute in the 
above equality this expression for yi only for the yi appearing in the left-hand side 
to obtain 

y 2 <8>(x 2 <8>y 2 -y 2 <8>x 2 +6 2 (2 2 )+y3(x3<8>y4-y4<8>X3-|-&3(3)+y4(x3<8>y3-y3®X3-|-64(3) = 0. 

Hence 

X 2 (8) y 2 - y 2 <8> X 2 + b 2 Q 2 = x 3 <8> y 4 - y 4 <8> X 3 + b 3 Q = x 3 <8) y 3 - y 3 ® x 3 + b A Q = 0 . 

Note that our Assumption yields that b 2 / 0 . Hence span(x 2 ,y 2 ) = span(xi,yi). 
Suppose first that 63 / 0 . Then span(x3,y 4 ) = span(xi,yi). This contradicts the 
assumption that xi,x 2 ,X3 are linearly independent. As x 3 = x 4 , we get also a 
contradiction if 64 / 0 . Hence 63 = 64 = 0 . So y 3 ,y4 € span(x3). This contradicts 
the assumption that y 3 and y 4 are linearly independent. 

In conclusion we showed that our Assumption never holds. The proof of this 
case of Theorem 1.1 is concluded. □ 



5.2 Case rank A(<S) > 4 

Proof. By induction on r = rank A(S) > 3. For r = 3 the proof follows from 
the results above. Assume that Theorem holds for rank S = r +1. Assume now that 
rank A(<S) = r + 1 and rank 5 = r + 2. Without loss of generality we can assume 
that n = r + 1. Suppose first that the assumptions of Lemma 5.1 hold. If we are in 
the case 1 then srank S = rank S. If we are in the case 2. then we deduce from the 
induction hypothesis that srank S = rank S. 

As in the proof of the case rank <S = 3 we assume the Assumption: There does 
not exist a decomposition of S to rank A(S) + 1 rank one tensors such that at least 
one of them is symmetric. We will show that we will obtain a contradiction. 

Suppose S = Y^i=i x * ® y i ® z i- The we have the equality 

n+1 

0 = ^ x* 8 > (y* <8 Zi - Zi <8 y,;) 
i=l 

and the fact that span of all x’s, y’s and z’s is F n . 

Without loss of generality we may assume that xi,... ,x n are linearly indepen¬ 
dent. So x n+ i = S-iOi*. Hence 

n 

X x » ® (yj <8 Zi - Zi (8) yj + a, : (y n+ i <8 z n+ i - z n+1 <8 y n +i)) = 0. (5.4) 

i+ 1 

As in the case n = 3 we can assume that y ra +i and z ra+ i are not collinear. Thus if 
a* = 0 we deduce that y * and z,; are collinear. If a % / Owe deduce that span(y,;, z*) = 
span(y n+ i, z n+ i). Since yi,...,y^+i span F ra we can have at most two nonzero 
a*. Since x n+ i / 0 we must have at least one nonzero a n . Assume first that 
n—1 out of {ai,..., a n } are zero. We may assume without loss of generality that 
oi = ... = a n -i = 0 and a n = 1. So x ra+ i = x n . Without loss of generality we may 
assume that 


n—1 

S = x„ <8 (y n <8 z n + y n+ i 8> z n+1 ) + ^ x* 8> y* <8 y*. 

i =1 

Since S is symmetric as in case n = 3 we deduce that y n 8> z n + y n+ i 8> z n+ i is 
symmetric and has rank two. So we can assume that z n = y n+ i,z n+ i = y n and 
dim span(y n , y n+ i) = 2. We now repeat the arguments in the proof of this case for 
n = 3 to deduce the contradiction. 

Suppose finally that exactly n — 2 out of {ai,...,a n } are zero. We may as¬ 
sume without loss of generality that a\ = ... = a n _2 = 0 and a n _i,a n / 0. So 
span(y„_i,z n _i) = span(y n ,z n ) = span(y n+ i,z n+ i). Hence y„-i,y n ,yn+i are 
linearly dependent. Since yi,...,y n +i span the whole space we must have that 
dim span(y n _i, y n , y ra +i) = 2. Without loss of generality we may assume the fol¬ 
lowing: First, y n ,yn+i are linearly independent and y n _i = ay n + by n +i- Second 
Zfc = yfc for k = 1,..., 7i — 2. So we can assume that 

n —2 n+1 n —2 n+1 

S = J2 ® yj + X! 0 y ' 7 y -.i X 7 x i 7y ' • X y i 0 x i 0 z i- 

jr = l J=n-1 j=l j=n— 1 
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Permuting the las two factors in the last part of the above identity we obtain: 

n—2 n +1 

0 = ^2 Yj ® ( x j ® yj - yj <8) xj) + ^2 Yj(xj <g Zj - zj (g> xj). 

j=1 j=n -1 

Substitute y n _i = ay n + 6y n +i and recall that yi,... , y n - 2 , Yn, Yn+i are linearly 
independent. Hence x,; and y* are collinear for i = 1,..., n — 2 > 2. This contradicts 
our Assumption. □ 


6 Theorem 1.1 for d > 4 

In this section we show Theorem for 1.1 for d > 4. Theorem 3.1 yields that it is 
enough to consider the case where rank S = rank A (5) + 1. We need the following 
lemma: 

Lemma 6.1 Let 2 < d £ N. Assume that x^i,... x j n+ i £ F” \ {0} and 
span(x :?) i,..., Xj jn+ i) = F” for j £ [d]. Consider the n + 1 rank one d-tensors 
0j = iXj t i,i £ [n + 1]. Then either all of them are linearly independent or n of these 
tensors are linearly independent and the other one is a multiple of one of the n 
linearly independent tensors. 

Proof. It is enough to consider the case where the n + 1 rank one d-tensors 
<8>j =1 Xj t i, i £ [ro+1] are linearly dependent. Without loss of generality we may assume 
that xpi,..., xp n are linearly independent. Hence the n tensors ® d j = \Xj^, i £ [n] are 
linearly independent as rank one matrices xi ; j <g> (<8>jL 2 x j,i) for i £ [n]. (I.e., the cor¬ 
responding unfolding of n tensors in mode 1 are linearly independent.) Assume that 
xgn+i = a ? x ij where not aj are zero. Since we assumed that 0^ =1 Xj.j, i £ 

[n + 1] are linearly dependent it follows that <g>^ =1 Xj jn+ i = E"=l b i ® d j =1 x i,i- So 
we obtain the identity Ya =i x i.* % = 0. Here % £ ® rf_1 F n is a tensor of at 
most rank 2. Since xii,...,xi n are linearly independent if follows that each 
7 i is zero. Hence if a* ^ 0 it follows that bj is not zero and ®j= 2 Xj^ n +i an d 
®j= 2 Xj,i are collinear. Therefore x^j and Xj n + i are collinear for j = 2,..., d. 
Since dim span(x Jj i,..., Xj jfl+ i) = n, we can’t have another / 0. So C) d =1 x ] n+ \ 
is collinear with <S>j=iXj j as we claimed. □ 

Proof of Theorem 1.1 for d > 4 and rank S = rank A(<S) + 1. Without 
loss of generality we may assume that n = rank A(<S) > 2. Assume that S = 
(8>j =1 Xj ) j. Clearly, the assumptions of Lemma 6.1 holds. Consider the d — 2 
rank one tensors ®je[dl\{p,g} x l,i f° r fixed p ^ q £ [d] and i £ [n + 1]. Suppose that 
these n + 1 rank one tensors are linearly independent. We claim that x p i and x qp 
are collinear for each i £ [n + 1]. Without loss of generality we may assume that 
p = 1, q = 2. By interchanging the first two factors in the representation of S as a 
rank n + 1 tensor we deduce: 

71+1 

^(x M <g> x 2 ,j - X 2)i (8) Xi,j) (g) (® d =3 x jt i) = 0. 

7 — 1 
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As <S>j = 3 Xj } i , i £ [n + 1] are linearly independent we deduce that x^j <g> X 2 ,?: — x ' 2 ,i <S> 
xj j = 0 for each i £ [n + 1 ]. I.e., x^j and X 2 are collinear for each i £ [n + 1 ]. 

Suppose first that for each pair of integers 1 < p < q < d ®je[d]\{p,<j} x ;/'+ * € [n+1] 
are linearly independent. Hence Xj^ £ span(xi i j) for j £ [d] and i £ [n+1]. Therefore 
<8)^ =1 Xj i j is a rank one symmetric tensor for each i £ [n + 1]. Thus srank S = rank S. 

Assume now, without loss of generality, that ® d = 3 Xj^,i £ [n + 1] are linearly 
dependent. By applying Lemma 6.1 we can assume without loss of generality that 
®j = 3 Xj t i, i £ [n] are linearly independent and <S> d =3 Xj >n+ i = <S> d =3 Xj, n . Without 
loss of generality we may assume that xj jU+ i = xy n for j > 3. (We may need to 
rescale the vectors X 2 , n +i,..., x^ n _|_i.) Hence xyi,..., x Jjn are linearly independent 
for each j > 3. Therefore we have the following decomposition of S as a 3-tensor in 
(<gi 2 F n ) ( 8 ) F n <8 (< 8 d_ 3 F n ): 

S= (xi, n <8>X 2 ,n + Xi , n+ 1 (8 X 2 ,n+l) <8> X 3) „ ® (< 8 >^ = 4 Xj jTI ) + (6.1) 

n— 1 n 

® x 2 ,i) ® x 3,i < 8 > (( 8 j=4 x j,i) = Ti <8 {® d j= 4 X^i). 
i— 1 2=1 

Clearly, < 8 j = 4 x_ j - ! i ,..., ( 8 j = 4 x j.n are linearly independent. Since 5 is symmetric by 
interchanging every two distinct factors p,q £ [3] in < 8 rf F" we deduce that 71,..., T n 
are symmetric 3-tensors. Consider the symmetric tensor T n = (xi in < 8 x 2 , n + x i,n+iC> 
x 2 ,n+i) <8> X 3 n . As the rank of A(T n ) in the the third coordinate is 1 it follows 
that rank A(S) = 1. Hence rank T n = 1 . Therefore rank S < n contrary to our 
assumptions. □ 


Corollary 6.2 Let |F| > 3,d > 3,n > 2. Assume that S £ S d F n . Then 
srank S = rank S under the following assumptions: 

1 . rank S < 3. 

2. srank <S < 4. 

Proof. It is enough to consider the case where n = rank A (S) > 2. 

1. Clearly, rank S £ {2,3}. Theorem 1.1 yields that srank <S = rank<S. 

2. Assume to the contrary that rank S < srank <S < 4. Then rank S < 3 
implies the contradiction rank S = srank S. 


. Part 1. 
□ 


7 Symmetric tensors over C 

Recall the known maximal value of the symmetric rank in S d C n , denoted as p(d, n): 

1. n(d,2) = d[6], [3, §3.1]; 

2. /r(3,3) = 5 [22, §96], [8] and [19]; 

3. M3,4) = 7 [22, §97]; 

4. n(3, 5) < 10 [10]; 
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5. /x(4,3) = 7 [17, 9], 


Theorem 7.1 Let F = C and 5 be a symmetric tensor in S d C n . Then srank 5 = 
rank 5 in the following cases: 

1. d > 3, n > 2 and rank 5 £ {rank A(S), rank A(5) + 1}. 

2. For n = 2 and d = 3. 

3. For n = 2 and d = 4 
n = d = 3. 

5. S £ S 3 C n and rank 5 < 5. 

6. S £ S 3 C n and srank 5 < 6. 

Proof. Assume that 5 £ S d C n . Clearly, it is enough to prove the theorem for 
the case rank A(5) > 2. Furthermore, we can assume that n = A(5). Thus it is 
enough to assume the following conditions: 

2 < n = rank A(5) < rank 5 < srank 5 < /i(d, n). (7.1) 

1. follows from Theorem 1.1. 

2. Assume 5 £ S 3 C 2 . As n( 3,2) = 3 we deduce the theorem from 1. 

3. Assume that 5 £ S 4 C 2 . Suppose that rank 5 £ {2,3}. Then 1. yields that 
srank S = rank S. 

Suppose that rank S > 4. As /j( 4, 2) = 4 in view of (7.1) it follows that srank S = 
rank 5 = 4. 

4- Assume now that S £ S 3 C 3 . Suppose first that rank A(<S) = 2. Then by changing 
a basis in C 3 we can assume that S £ S 3 C 2 . Part 2. yields that srank S = rank S. 

Suppose that rank A(S) = 3. If rank S £ {3,4} then 1. yields that srank S = 
rank S. Suppose now that rank S > 5. (7.1) yields that srank S > 5. The equality 
/j(3,3) = 5 yields that rank 5 = 5. Hence srank 5 = rank 5 = 5. 

5. (7.1) yields rank A(5) < 5. If rank A(5) = 2 then 2. yields that srank 5 = 
rank 5. If rank A(5) = 3 then 4- yields that srank 5 = rank 5. If rank A(5) > 4 
then 1. yields that srank 5 = rank 5. 

6. Assume to the contrary that rank 5 < srank 5. So rank 5 < 5. 5. implies the 

contradiction rank 5 = srank 5. □ 


8 Two version of Comon’s conjecture 

In this section we assume that F = R, C. 

8.1 Border rank 

Definition 8.1 Let T £ <g> rf F n \{0}. Then the border ofT, denoted as brankp T, 
is r £ N if the following conditions hold 

1. There exists a sequence Tk £ (g> rf F n , k £ N such that rank Tk = r for k £ N and 

limfc—>-<x> Tk — T. 
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2. Assume that a sequence Tk £ <S> d F n ,k £ N converges to T- Then 
liminffc^oo rank Tk>r. 

Clearly, brankp T < rank T. For d = 2 it is well known that brankp T = rank T. 
Hence 

rank A(T) < brankp T. (8-1) 

For d > 2 one has examples where brankp T < rank T [7]: Assume that x, y £ F n 
are linearly independent. Let 

5 = x<g>x(g>y + x(g)y<gix + y<g)x(g>x, 5 = lim-(ig> 3 (x + ey) — (g^x). (8.2) 

£—>■0 e 

It is straightforward to show that rank 5 = 3, brankp 5 = 2. (See the proof of 
Theorem 8.3.) 

Assume that 5 £ S^F” \ {0}. Then the symmetric border rank of 5, denoted as 
sbrankf 5, is r £ N if the following conditions hold 

1. There exists a sequence S k £ S d F n ,k £ N such that srank 5^ = r for k £ N 
and linifc^oo S k = 5. 

2. Assume that a sequence Sk £ S d F n , k £ N converges to 5. Then 
lim inf/j^oo srank Sk > r. 

Clearly, srank 5 > sbrankp 5 and sbrankp 5 > brankp 5. Thus we showed 

rank A(5) < brankp 5 < sbrankp 5 < srank 5. (8-3) 

The analog of Conron’s conjecture is the equality brankj- 5 = sbrankp 5. See 
[4], The analog of Theorem 1.1 will be the following conjecture: 

Conjecture 8.2 Let d > 3, F = R, C and S £ S d F ra . Suppose that brankp 5 < 
rank 5 and brankp 5 < rank A(5) + 1. Then sbrankp 5 = brankp 5. 

The following theorem proves the first nontrivial case of this conjecture: 

Theorem 8.3 Let S £ S d F n for F = M, C, d > 3, n > 2. Then brankjj- 5 = 2 < 
rank 5 if and only if there exist two linearly independent x, y £ F" and a, b £ F, b / 0 
such that 

d-1 

5 = a ® d x + b ^(<g> J x) (8) y <g> (<8> rf-J ‘ _1 x) (8.4) 

3=0 

In particular brankp 5 = sbrankp 5. 

8.2 Proof of Theorem 8.3 

Lemma 8.4 Let F = M, C and assume that A = [cq,j] ? ;g [M],je[N] € F MxN , r - 
rank A. Suppose that the sequence Ak = Yli=i x *,fcy/jfc’ ^ € N satisfies the following 
conditions: 

lim A k = A, lim x uk = x, : for i £ [qj. (8.5) 

k —yoo /c—>-oo 

1. Assume that q = r. Then there exists a positive integer K , such that for k > K 
the two sets of vectors x\ )k , ..., x r> fc and yi , k ,..., y r . k are linearly independent. 
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2. Assume that xi,... ,x q are linearly independent. Then 


<? 

lim y ijfc = y* for i £ [q\ and A = ^ x iyJ ■ (8-6) 

2=1 

Furthermore, dim span(yi,..., y q ) = r. In particular, if q = r then yi,... ,y r 
are linearly independent. 

Proof. Clearly, rank A k < q. The first condition of (8.5) yields that q > r. 

1. Suppose q = r. Hence rank A k = r for k > K. Hence the two sets of vectors 
xi^.,..., x r ^ k and yi , k ,..., y r . k are linearly independent. 

2. Complete xi,..., x q to a basis xi,..., xm in F M . Let zi,..., zjv be a ba¬ 
sis in F^. Hence XjZ J,i £ [M],j £ [IV] is a basis in ¥ MxN . Therefore A k = 
Y^iG[M]je[N] a ij,k x i z J for fceN. The first equality of (8.5) yields that lim*..^ a ijtk = 
a t j for i £ [M] , j £ [A r ]. The second equality of (8.5) yields that x^,..., x q>k , x q+i, ■ ■ 
is a basis in ¥ M for k > K. In what follows we assume that k > K. Let 
Qk £ GL (M, F) be the transition matrix from the basis [xi,..., x q , x q+ i ,..., xm\ 
to the basis 

[xi,fe, • • •, Xq ;fe , x 9 + i,..., x M \. Clearly, lim*-**, Q k = I M ■ Then 

A k — ( bij'kXi^fcZj. 

ie[M],je[N] 

Compare this equality with the assumption that Ay. = Yli=i x i,kyJ k f° deduce that 
hj,k = 0 for i > q and y ijfc = J2je{N] b ij,k z j for i £ [<?]■ Let A k = [a ijjk ],B k = [b ijjk \ £ 
¥ MxN . Then B k = Q k A k . Hence lun^^ B k = lim k ^ooQ k A k = A = [a^]. This 
shows (8.6). Since rank A = r it follows that dim span(yi,..., y q ) = r. Thus if 
Q = t yi,..., y r are linearly independent. □ 

Assume the assumptions of Definition 8.1. Without loss of generality we can 
assume that 

r 

% = ^2 ||xij,fc|| = l,i £ [r\, j £ [d-l},k £ N. (8.7) 

2=1 

By considering a subsequence of k £ N without loss of generality we can assume 
that 

lim Xjjfc = Xij i £ [r],j £ [d - 1]. (8.8) 

k—t OO 

(Here ||x|| is the Euclidean norm on F".) 

Lemma 8.5 Let S £ S d ¥ n ,d > 3, n > 2. Assume that 1 < r = rank A(«S) = 
brankp S < rank S. Let T k £ ® d ¥ n ,k G N be a sequence of the form (8.7) 
satisfying (8.8). Assume furthermore that Hindoo T k = S. Then the tensors 
® d Z\x\ 3 ,..., tg) d I J x r j are linearly dependent. 

Proof. Assume to the contrary that the tensors <8 >^zJxij, ..., J x r j are lin¬ 
early independent. Lemma 8.4 yields that lim^oo x^fc = x l ( j for i £ [r]. Hence 
S = Tf_ l ® d = ] x,j j. Thus rank S < r which contradicts our assumptions. □ 


, X M 
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Lemma 8.6 Let A £ ¥ MxN be a matrix of rank two. Assume that A k = — 

Cfcd J,k £ N converges to A. Suppose furthermore that 

1 T a fc = a, lim = c, c = aa for |a| = 1, (8.9) 


lim 


k^-oo ||a fe || k—>oo \\c k \ 

lim ——r-bfc = b, lim 


11111 —- 

k—> oo 


rdfc = d. 


Then 


b = ad, lim |a/ c | 

k—t OO 


11111 Tj—-- 

k—> oo dfc 


bfc|| = lim ||cfc||||dfc|| = oo, lim 

k—fOO b—irv 


l|cfc||||d fc || _ 


inn jj-—f 

k—>oo || ||bfc| 


= 1. 


( 8 . 10 ) 


Furthermore A = af T + gb T , where span(a, g) = Ranged and span(b,f) = 
Range A T . In particular, g and f are limits of linear combinations of a k ,c k and 
bfc, dfc respectively. 


Proof. Observe that 

F - - (|^>(lld*IIIMI)(|^d). ( 8 .ii) 


Suppose first that span(b) 7 ^ span(d). Then b and d are linearly independent. 
Lemma 8.4 yields that A T = aba T + cda T . Hence rank A = 1 which contradicts 
our assumptions. As ||c|| = ||d|| = 1 it follows that b = /3d for some scalar /3 of 
length 1 . 

We next observe that a £ Range (A) and b £ Range A T . Indeed, without loss of 
generality, we can assume that rank A k = 2 for k £ N. Hence a^ € Range (A/-), b k £ 
Range (Aj). As huik-too A k = A the assumptions (8.10) yield that a £ Range A, b £ 
Range A T . 

Assume that the sequence {||a*.|| ||b*.||}, k £ N contains a bounded subsequence 
{rifc}, k £ N. Since Hindoo A k = A it follows the subsequence ||c nfc || ||d nfc ||. k € N is 
also bounded. Taking convergent subsequences of the above two subsequences we 
deduce that A = qab T . This contradicts our assumption that rank A = 2. Hence 
the second equality of (8.10) holds. Rewrite (8.11) as 


A k = ||a fc ||||b* 


a k 


r a ^)(i 


b 


1 1 t\ / II c fc IIIIdfc |, , 

> V II_II IIU. II A I 


a fc 


M Ct)< Pii d ‘ )) ' 


Use the assumptions that lim^oo A k = A, where rank A = 2, the facts that ||a|| = 
||b|| = ||c|| = ||d|| = 1 and c = aa, b = /3d to deduce the third and the the first part 
of (8.10). 

It is left to show that A = af T + gb T . Choose orthonormal bases xi,... , xjv 
and yi,..., y^v in and W N respectively with the following properties: 


xi = a, span(xi,X 2 ) = Range A, yi = b, span(yi,y 2 ) = Range A T . 


In what follows we assume that 1 > 1. Choose orthonormal bases xi ] fc,x 2 k and 
yi ifc ,y 2 ,fc hi Range A k and Range Aj respectively such that 

xi )k = 77 — 77 ^, yi,fe = -yr-n-b/c, lim x- 2 ,k = x 2 , lim y 2 ,k = Y 2 - 

\\3Lk\\ ||Dfc k—> oo k^-oo 
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Observe next that {xi )fc , x 2) fe, x 3 ,..., x M } and {ygfc, y 2 ,fc, y 3 , • • •, yiv} are bases in 
¥ ai and F jV which converge to bases xi,..., xjv and yi,..., yiv respectively. 

In the bases {x 1;fc , x 2;fc , x 3 ,..., x M } and {yi, fc , y 2 ,fc, y3, • • •, Yn} the rank one 
matrices a^bj, c&dj are represented by the following block diagonal matrices: Gy- = 
Ck 0 0, Dk = Df~ 0 0 where 

bk Ck 
dk Ck 

Note that a*. = ||a^|| ||bfc||. Hence lim^oo ak = oo. As lim^oo Ak = A the argu¬ 
ments of the proof of Lemma 8.4 yield that linifc-xx) Cfc — Dk = E = [e^] € F 2x2 . 
Hence lim fc _>. 00 6fc = oo. Therefore D k = b k u k vj, where uj = (1 = (1 ,Vk). 

Furthermore 

lim bkUk = e 2 i =>■ lim Uk = 0, lim bkVk = ei 2 => lim Vk = 0. 

k—t oo k—t oo h —^oo k—>oo 

Finally, observe that e 22 = lim k^-oobkUkVk = 0. This yields that E = (l,0) T u T + 
v(l, 0) for some choice of u, v £ F 2 . Hence A = af T + gb T as claimed. 

As rank Ak = 2 and lim*,-^ Ak = A it follows that g and f are limits of linear 
combinations of and b^d^ respectively. □ 


C k = 


a k 0 

0 0 


Dk = 


Proof of Theorem 8.3. Assume first that 5 is of the form (8.4) where b ^ 0. 
Without loss of generality we can assume that 6=1. Clearly, Range A(5) = 
span(x,y) Hence rank A(S) = 2. Let T(e) := a<8> d x+i(<8>' i (x-|-ey) — ® rf x) for e / 0. 
Then rankT(e) = 2 for e -1 / a. Clearly, lim e ^o T(e) = S. Hence brankp 5 = 2. 
As T(e) € S d ¥ n it follows that sbrankp 5 = 2. We claim that rank 5 > 2. We can 
assume without loss of generality that n = 2 and x = ei = (1, 0) T , y = e 2 = (0, 1) T . 
Assume first that d = 3. So 5 = [si,j,k] where 

Si,1,1 = a, Sl,l i2 = Sl,2,l = 52,1,1 = 1, Sl,2,2 = 52,1,2 = 52,2,1 = 52,2,2 = 0. 


Let 


F — [sij,l]jjg[2] 


a 1 

1 0 ’ 


G — [si,j,2\i,je[2] 


1 0 
0 0 


Then rank 5 = 2 
Clearly, GF~ l = 


if and only if the matrix GF 1 is diagonalizable, see e.g. [13]. 


0 1 
0 0 


is not diagonalizable. Hence rank 5 > 2. It is easy to 


show straightforward that rank 5 = 3. 

Assume now that d > 3. Let <fr : F 2 —> F be the linear functional such that 
4>(e i) = (/>(e 2 ) = 1. Consider the following map ^ : (F 2 ) d —> ® 3 F 2 : ^((iii,..., ty)) = 
(IlJ=4^( u i))®Li u i- Clearly, ip is a multilinear map. The universal lifting property 
of the tensor product yields that V’ lifts to the linear map T : 0 rf F 2 —> <g) 3 F 2 such 


that 


d 

^ (®j =1 ui)=( n 0(uj)) ®? = i uj. 


3 = 4 


Observe that a rank one tensor is mapped to either rank one tensor or zero tensor. 
Clearly, the image of a symmetric rank one tensor is a symmetric tensor of at most 
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rank one. Hence T : S^F 2 —> S 3 F 2 . Assume that S of the form (8.4), where x = ei 
and y = e 2 . Then 


'L(iS) = (a + (d — 3 )6)x ® x ® x + 6(y ®x(g)x + x<g)y<g>x + x<g>x(g)y). 


Assume to the contrary that rank S = 2. Then rank 4/(5) < 2. This contradicts 
our proof that rank 'F(tS) = 3. Hence rank S > 3. 

Assume now that S £ S d ¥ n and 2 = rank A(<S) = brankp S < rank S. Let 
71. £ <g> d F n be a sequence of tensors of rank two converging to S. So 71- = <8>j =1 Xj^ — 
®^_i yj,k- Since rank A(<S) = 2 we can assume without loss of generality: First, x^. 
and yj'k are linearly independent for j £ [d]. k £ N. Second, 


lim ■ 

k —^oo 


rX 


x 


■jM 


j,k 


= X 


3 ’ 


lim 


k^oo ||y j'le 


\Yj,k 


Yj for j € [d]. 


Lemma 8.5 yields that CZ^zjxj and are linearly dependent. Hence span(xj) = 

span(yj) for j £ [d — 1]. Lemma 8.6 yields that x^ and y d linearly dependent. So 
span(x^) = span(y^). Apply Lemma 8.6 to A = A(5) T ,A/ C = A(Tk) T ,k £ N. It 
then follows that S = (<8>jZ }xj) ® z + F ® x^ for some F £ ® d ^ 1 F" . Furthermore 
span(xrf, z) = Range A(<S). As x^ and z are linearly independent and S symmetric it 
follow that ® d Z^,F £ S rf_1 F”. Hence span(xi) = • • • = span(xrf_i) = span(x). Thus 
®j~ 3 Xj = t <g> d_1 x. By considering the unfolding of S in another mode we deduce 
that span(x^) = span(x). Observe next that rank J 7 > 1. Otherwise rank <S < 2 
which contradicts our assumptions. Lemma 8.6 yields that J 7 is a limit of linear 
combinations of <g>jZ}xj.fc and ®^ZiYj,k- Hence brankpj 7 < 2. As rank F > 1 it 
follows that brankp F = 2. In summary we showed: 


S = ® d 2 x (g) z + F ® x, (8.12) 

span(x, z) = Range A(5), F £ S d-1 F n , brankp F = 2. 


We now prove the following claim: Assume that S £ S rf F ra , rank A(5) = 2 < 
rank S. Suppose furthermore S is a limit of linear linear combinations of ®j = iX.j y k, ®j=iyj,k, 
where the the following limit exist and satisfy: 

lim 1 ., Xj ifc , lim 

fc-Hx> llx^fcH fc->oo ||y j t k 

Then (8.4) holds. 

We prove the claim by induction on d. Assume first that d = 3. Observe first 
that two dimensional subspace Range A(<S) T = span(a, c), as given by Lemma 8.6, is 
in S 2 F n . i.e. the space of symmetric matrices. Lemma 8.6 yields that J 7 is a limit of 
linear combinations of xi ifc <g>x 2 ,fc and yi,fc®y 2 ,fc. As lim^oo y Xl fe |M|x 2 fc || x i,fc<g)x 2 ,fc = 
fx (g> x it follows that Range A(<S) T contains rank one matrix x <g> x. Lemma 8.6 
yields that Range A(<S) T contains a rank two matrix of the form x<g>f + g®x. Since 
this matrix is symmetric it is of the form cx(g)x + x<g>u + u<8>x for some scalar c 
and u £ F” which is linearly independent of x. Hence F = dx(g)x + x(g)v + v(g>x for 
v = du, d 0. As rank A(<S) = 2 it follows that span(x, v) = span(x, z). Therefore 
we showed that 


y j,k £ span(x) for j £ [d]. (8.13) 


S = ax<gix<gix + 6x(g)x<g)v + c(x ® v + v <g) x) <g) x. 
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Interchange the last two factors in S to deduce that 0 = (b — c)(x<g>x®v — x(g>v0x). 
Hence b = c and (8.4) holds for d = 3. 

Assume now that (8.4) holds for d = p and suppose that d = p + 1. Consider 
(8.12). Suppose first that 2 < rank F. Then the induction hypothesis applies to F. 
Hence F is of the form (8.4) and 

p -1 

S = g> p x ( 2 > z + (a g> p x + b ^ g^x (g> y <g> (<8> p_1 ~ :, x)) (g> x, b ^ 0. 

3 =o 

Note that Range A(<S) = span(x, y) = span(x, z). Hence 

p -1 

S = a' <g> p+1 x + cg> p x<g>y + 6^ <g4x g> y g> (ig^x). 

j=o 

Interchange the last two factors in S to deduce that (c-6)® p ' 1 x(x®y-y®x) = 0. 
Hence b = c and S is of the form (8.4). 

It is left to consider the case where F is a symmetric tensor of rank two. So 
rank F = 2. Hence rank A(F) = 2. Theorem 3.1 yields that F = s <S> P u + 
t <S> d v, were s,t = ±1, and this decomposition is unique. (The ± are needed if 
F = R and p is even.) Clearly, span(u, v) = Range A(S). It is enough to assume 
that n = 2. Recall that A{F) is a limit of a linear combinations of two rank one 
matrices: xi ) fc((g>^ = 2 Xj ) fe) T , yi,fc((g>j = 2 yj,fc) T , k G N. The assumption (8.13) implies 
that we can use Lemma 8 . 6 . Hence J 7 = x®5 + g® (< 2 > p_ 1 x). Therefore <g) p_1 x G 
span((g) p_ 1 u, (g) p_ 1 v). We claim that this possible if and only if either span(x) = 
span(u) or span(x) = span(v). Suppose to the contrary that span(x) / span(u) or 
span(x) 7 ^ span(v). So <g> p_1 x = s(g ) p_1 u + t(g ) p_1 v. Clearly st / 0. Let <j> : F 2 —» F 
be a nonzero linear functional such that </>(x) = 0. Let 'L : <g) p ^ 1 F 2 —> <g) p ^ 2 F 2 be 
the linear mapping of the form given above: ^((g^Z^Wj) = <j)( wq) <g ) P Z^ w j- So 

0 = ^((g)^ -x x) = sc/>{ u) <g> p_2 u + tc/>(v) ® p ~ 2 v. 

This is impossible since u and v are linearly independent. Thus we can assume that 
span(v) = span(x), T = s <g> p u + t' <2> p x and z G span(u, x). Thus 

S = a (g) p+1 x + 6<g) p x(g)u + s(g) p u(g)x. 

As rank S = 3 it follows that S' := S — a (g) p+1 x is a symmetric tensor of rank 
two. Theorem 3.1 claims that the decomposition S' = g> p x g> u + s <g ) p u g> x is 
unique and (g) p x (g) u, (g> p u <g) x are symmetric tensors. So span(u) = span(x) which 
contradicts our assumption that u and x are linearly independent. □ 


8.3 Approximation of symmetric tensors 

Define on (g) d F n the standard inner product: 

{V, Q) := PiuSdQi 1 i«f» V = \Ph,:,idl 2 = fei € ® dlF ”- 

ij€[n],je[d\ 
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Observe that (<8>j =1 Xj,<8>j =1 yj) = n y -=i( x j> Yj)- Assume that k € [l,d — 1]. Denote 
by Gr(£:,F ra ) the Grasmannian manifold of ^-dimensional subspace in F". Let 

Gr(fc, d, F n ) := {®* =1 Uj, U y € Gr(fc,F n ),j € [d]}. 

For a given <g>^ =1 Uj denote by P^d : fgi^F" —> <2>j =1 Uj the orthogonal projection 

of (g) d F n on <8> d = i U y . A best ^-approximation of T € <g> d F n is each tensor T* 
satisfying 


min WT-P& XJ (r)II = IIr-n, T = P^d u* 

5^ =1 UjeGr(fe,d,F") ^ =1 ] J =1 * 


(T),^ =1 U y G Gr(fe, d, F n ). 


See [14, 16]. The results of [15] yield that T* is unique for T outside of a semi- 
algebraic set of dimension less than the real dimension of (g> d F n . The analog of 
Comon’s conjecture is: 

Conjecture 8.7 Let n — 1, d — 1 G N, k £ [d — 1] and S € S d F ra . Then a best 
k-approximation of S can be chosen to be a symmetric tensor. 

This conjecture is known to hold in the following cases: For d = 2 it is a consequence 
of Singular Value Decomposition. For k = 1 and d > 2 it follows from Banach’s the¬ 
orem [2]. See [13] for F = M. Similar arguments combined with Banach’s theorem 
yield the case F = C. It is shown in [14] that for F = M there is a semi-algebraic set 
in S d W n of dimension dim S d M. n for which the conjecture holds. 


Acknowledgment: I thank Lek-Heng Lim for bringing my attention to Comon’s 
conjecture, to Joseph M. Landsberg and the anonymous referees for their useful 
comments. 
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